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Introduction: 



The Inquiry Role Approach is a method of teachinc] secondary biology v/hich 
includes teacher training materials, teacher instructions for class use, and 
student materials. While tlie goals of l\V\ include the learning of biology 
content, the goals also emphasize inquiry skill development, social interaction 
skills, and attitude development necessary for good inquiry. The IRA method is 
based on the premise that biology content understanding, inquiry skills, social 
skills, and attitudes are interdependent and can be achieved best in a program 
that integrates them. 

Student develonrnent objective's for the areas of biology content understand- 
ing and cognitive inquiry skills have been identified both generally (Bingman, 
et aj^., 1969; Development of Inquiry Skills Program Staff, 1970) and specifically 
for eacli program activity (see Development of Inquiry Skills Program, 1971a) 
from early in the development of IRA. Instruments for measuring achievement 
in these areas have also been identified—Coi.iprehensi ve Final Examination (Bio- 
logical Sciences Curriculum Study, 1965) and Explorations in Biology (Koos, 
1969-72), These instruments have had a lengthy and systematic development and 
have shown to be useful, highly reliable and valid for v/hat they intended to 
measure. (These instruments are discussed in the first paper of this paper set, 
Seymour, ejt al^. , 1974» ) 

Student development objectives for the areas of social skills and attitudes 
have been identified generally (Bingman, £t aj_. , 1969; Development of Inquiry 
Skills Program, ly70). Mov/ever, a systematic specification of social skill 
and attitude objectives v/ithin tlie activity-by-activity materials, and identi- 
fication of means .for measuring achievement in these areas, had not been under- 
taken in the early stages of program development. During the revision of material 
prior to the 1972-73 field test, this issue of specifying and measuring social 
skill and attitude development v/as addressed. Tlie purpose of this paper, there- 
fore, is to report the results of that and subsequent v/ork. 

This paper will: (1) Review the social skill and attitude goals and measure- 
ment of the attainment of these goals in the early development of IRA. (2) 
Identify the social skill and attitude development goals specified in the in- 
structional materials field tested in 1972-73. (3) Describe the instruments 
used to measure attainment of these goals during the 1972-73 field test. (4) 
Present and discuss the data collected using these instruments. And (5) discuss 
future directions for further development of these instruments. 



Social Skills Measurement 

Instruments during early IRA development : 

The primary method of developing social skills in the Inquiry Role Approach 
program is the use of four-member teams with specific role designations. Each 
role has a set of related tasks assigned as the role responsibilities of the 
person who is performing the role« The four roles are: Te am Coord ina tor- - co- 
ordinates team discussion, clarifies team direction, summarizes or synthesizes 
team discussions and decisions; Technical Advisor— assists team in analyzing. 
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challenging, and understanding concepts, principles, statements of evidence, 
underlying assumptions, etc.; leads team in teciinical aspects of laboratory 
work; Data l!ecorder- -records, or directs the recording of data and notes of 
team's discussions; organizes and maintains team records; checks for consistency 
in records and bctv/een records and team decisions or interpretations; and Process 
Advisor- -leads team in analysis of team interaction, identification of strengths 
and weakr^esses, and planning actions to improve teamv/ork. 

In order to assist the student in learning and fulfilling his/her role 
responsibilities, a student form outlining specific tasks was given to students. 
These role responsibilities forms at least in part identified social skills 
needed for successful group interaction. Students evaluated their role perfor- 
mance at the. end of an activity by completing a role performance checklist; 
the team identified whether or not each student had performed the tasks assigned. 
The team also completed a Team Analysis Form in which they recorded social and 
cognitive problems that occurred during teairn/ork and plans for overcoming their 
problems^ 

While all of these forms (role responsibilities form, role performance 
checklist, team a?ialysis form) were developed through student and teacher feed- 
back, thoy did not provide either a specification of skills to be developed or 
a reliable and quantified means of evaluating development. 

One instrument did provide quantified data-- Differentiation Be tween Roles— 
a 20-item quiz designed to measure understanding of role responsibilities. 
Alone, however, it is not a measi^re of social skill development. Revision of 
this instrument and later studies of its reliability are included later in this 
paper in discussion of the instrument Understanding Role Responsibilities . 

Social Skill Development Goals : 

Drawing from the previously identified general social skill development 
goals and the instructional materials included in the IRA program, social 
skill goals were identified for each of the themes* as part of the IRA 
revision for the 1972-73 field test. These goals follow: 

THEME I SOCIAL SKILLS ; 

Prerequisite to performing the roles and thus developing the skills associ- 
ated with a role, the student must understand the role responsibilities. 

In addition to knowing role responsibilities, skills will be developed in 
the following areas: 

COORDINATION — 

n Organize the work to be done. 

2. Coordinate team activities to reach team decisions or complete 
tasks. 

' t 

*The IKA program activities are organized into three sequential sets of activities 
called themes* 
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3. Identify various positions or ideas. 

4. Ask for questions and/or clarifications. 

5. Build on each other's ideas or suggestions. 
COMMUtllCATION 

bl ToTe part in team discussions by expressing your ideas. 

7. Listen to other team members and try to understand clearly v/hat 
they are saying. 

8. Respond to other team members' ideas and opinions. 

ROLII PERF O RIIAIJCE 

9. Recognize v/hen a role responsibility has not been performed. 
10.. Suggest ways to overcome role responsibility problems. 

11. Carry out your role responsibility. 

THEME II SOCIAL SKILLS : 

The coordination, communication, and role performance skills developed in 
Theme I will be used to build successful social interaction, build team spirit, 
and create an atmosphere of acceptance. 

SOCIAL INTERACTION — 

T7 Recognize v/hen conflicts arise between teammates. 

2. Identify the conflict and bring it to the team's attention. 

3. Suggest ways to solve the problem. 

4. Accept each person during the problem-solving process. 

5. Identify and suggest different ways to improve teamwork. 

BUILDING TEAM SPIRIT/EXPRESSING ACCEPTANCE — 

6. Praise good ideas or responsibifities performed well. 

7. Recognize the different talents of team members and use them 
effectively. 

8. Relieve tension in the team through a sense of humor or other 
"break in the action." 

9. Understand and accept a team member's feelings, particularly when 
his behavior is rejected by others. 

lO'. Direct criticism to a person's ideas, not the person himself. 



THEUE III SOCIAL SKILLS ; 

The social skill noals for Theme III are behaviors which combine and in- 
tegrate skills developed in Tliemes I and IK 

COORDIIIATIOIi/COIulUiaCATION — 

TT TTsk" others for their ideas as often as you give your own. 

2, Vihen others present ideas, explain your understanding of what has 
been said and then ask if that is what was intended, 

3, Help students having difficulty during discussion so the student 
can continue and complete liis point of discussion. 

ROLE PERF OPMA NCE/SOCIAL IMTERACTIQN ~ 

4, Identify instances in which role responsibilities for two or more 
roles overlap. 

5, Suggest ways of redefining or exchanging roles within the team 
to match tlie role responsibilities to each team member's demon- 
strated talents and skills. 

6, Carry out extra or modified responsibilities delegated to you by 
the team as effectively as those responsibilities ordinarily 
assumed in your role, 

7, Initiate action to resolve conflicts among teammates regardless 
of what role you have. 

8, Reconcile and con^nicate differences of opinion, ideas, and 
feelings when different from those of other teammates. 

■ COORDItlATIOM/RESPOIISIBILITY/PERSEVERANCE 

T. 'Encourage team members to continue working to solve the problem 
under investigation. 

10, Participate willingly in making team decisions and team planning 
even v/hen your own ideas are not being adopted. 

11, Participate willingly in carrying out team decisions and plans ' 
even when they are based on ideas suggested by others. 

Measuring Social Skill Development : 

It was decided thbt a simple way to measure this array of social skills 
v/as to utilize always-present observers: the student and his/her three team- 
mates. A social skills checklist was designed for each theme. The cliecklist 
was to be completed first by the student, then by the team (with the equal 
participation of the student being rated). The final rating would be the average 
of the student's own rating and the team's rating. 

Validity of the checklist was established by the professional judgment 
of McREL staff and consultants including IRA teachers. 

The social sMlls checklist- for Theme I follows. 
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Social Skills Che cklist (IRA student form 121-4, Bingmcin, et al^. , 1972) 
(Copyrighted by Mid-continent Regional Educational Laboratory; do not 
reproduce without permission.) 



HAIiE: 



TEAtI MEMCERS: 



Summary : To help you determine your social skills development, you and 
your teammates will fill out this checklist. 

1-very poor 2-poor 3-satisfactory 4-good 5-excellent 

YOUR TEAM 
RATING RATING 

THEME I - ORIENTATION TO INQUIRY 

COORDINATION 

T7 Organizes the work that needs to be done. . 



2. Coordinates team activities to reach team 
decisions or complete task. 

3o Identifies various positions or ideaso 

4. Asks for questions and/or clarifications. 



5. Builds on each other's ideas or suggestions. 
COMMUNICATION 

Ti blokes part in team discussions by expressing 
his/her ideas*. 



2. Listens to other team meiribers and tries to 
clearly understand what they are saying. 

3o Responds to other team members' ideas and 
opinions. 

ROLE PEPsFORMAflCE 

•To Recognizes \/hen a role responsibility has not 
been performed. 

2. Suggests ways to overcome role responsibility 
problems. 

3. Carries out his/her role responsibilities. 

Your rating + team rating divided by 2 = Theme I 
social skills rating: 
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In view of the 1 throucih 5 ratinn system, ratings can be interpreted 
according to the follo'.n'nc] scale: 

Excellent 50-55 

Good 39-40 

Satisfactory 28-38 

Poor 17-27 

Very Poor 11-16 

A rating of 28 v/qs set qs the criterion level. 

This checklist was aclMinistered to students at the end of Theme I (approxi- 
mately at the end of the first semester of the academic year). The results per 
teacher are shown in Table 1. 

TABLE 1: Social Skills Checklist Data From End of Theme I 









Population 








from which 






Student 


sample v/as 


Teacher No. 


J 


N ■ 


taken 










. 01 


33o8 


24 


150 


02 


43.2 


24 


140 


03 


40.2 


22 


80 


04 


49.4 


26 


30 


10-14 


33.4 


77 


500 


20 


35.9 


20 


35 


21 


41.0 


20 


70 


22 


42.4 


26 


70 


30 


38.8 


26 


105 


31 


43.2 


25 


105 


40 


42 


103 


103 



The results siiow that all student groups reached criterion on the social 
skills checklist. The mean scores' ranged from 33.4 to 49.4. Three teachers 
reported student mean scores classified as "satisfactory" and eight reported 
mean scores in the "good'* category. 

The criterion referenced reliability (Thorndike, 197!, p. 435) for this 
instrument was found to be 0.84 (fl=25). The rank correlation (Spearman) be- 
tween the individual's rating and the group's rating was 0.92 (11=20). 

The Theme II and Theme III social skills checklists follow the pattern of 
the Tlieme I. checklist. The Theme II checklist included all items from Theme I 
plus additional items relating to the Theme II. social skill development goals. 
Tlie Tlieme III checklist included items relating to the Theme II and Theme III 
social skill development goals (but not items from the Theme I checklist). 
Eight teachers (teachers 02, 03, 10, 11, 12, 13, 14, and. 21) submitted data from 
administration of the Theme II checklist. One teacher (03) submitted- data from 
administration of the Theme III checklist. 
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Ratings for both the Theme II and Tliome III checklist can be interpreted 
according to the following scale: 

Excellent 95-105 

Good 74-94 

Satisfactory 53-73 

Poor 32-52 

Very Poor 2? -31 

Criterion level for both instruments v/as set as 53. 

Data from these instruments is shown in Table 2. 



TABLE 2': Social Skills Checklist Data, Thtinies II and III 





V 


S.D. 


M 


Population 
from which 
sample was 
taken 


Theme 


II 












Social 


Skills 


Checklist 


71.8 


13.3 


50 . 


790 


Theme 


III 












Social 


Skills 


Checklist 


74.3 


18.35 


20 


80 



The criterion referenced reliability for the Theme II checklist v/as found 
to be 0.60 (N=50); for the Theme III checklist, 0.64 (N=20). Rank correlations 
between individual ratings and qroiip ratings were 0.86 (Theme II checklist N=20) 
and 0.85 (Theme III checklist N=20). 

The data resulting from the use of these three r.ocial skill checklists 
indicates that the social skills measured are developed and that criterion 
levels are not too high. Further studies of the validity, reliability, and 
setting of the criterion levels are suggested and will be discussed later in 
this paper. 

Understanding Role Responsibilities : 

As noted in the section Social Skill Development Goals, student role per- 
formance (and, tlierefore, social skill development) is dependent on understand- 
ing the role responsibilities. Therefore, use of the instrument Understanding 
Role Responsibilities has been included as part of the measurement of social 
skill development. The development of this 20-item, multiple choice instrument 
has occurred over the past three years. Revisions have occurred periodically 
to keep items consistent with development of instructional materials on roles 
and in response to student and tecxcher feedback on the clarity and accuracy 
of items, A portion of the instrument as used in the 1972-73 field test follows. 
Only the. first four (of twenty) items are shovm. 
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Understanding Role Responsibilities {1\V\ student form 121-3, Bingman, 
e^al., 19727) 

NAME: role: 



Summar y: This form is desicjned to assess your understandings of the 
responsibilities associated with each role. Each statement v/as made by 
a team member while carrying out a particular role. You are to identify 
which role v/as being carried out, 

TC-Team Coordinator TA- Technical Ad visor DR-Data Recorder PA-Process Advisor 

Bob, do you think this evidence is enough for this 
interpretation? 

In order to reach a decision, can we find a way to 
make your statement go along with the statement made 
earlier by Tom? 

I don't think everyone sees a plan for tomorrow, 

\ihen you use the word "satisfaction" what assumption 
are you making? 

Understanding Role Responsibilities is the product of three years of develop- 
ment. In the 1970-71 IRA materials the instrument used to measure role under- 
standing v/as Differentiation Between Roles. The validity of this 20-item instru- 
ment was judged by interviewing and observing teachers ^nd students (Anderson, 
et al^, , 1971). The instrument was then revised and included 13 unchanged items 
and seven modified items, A test-retest reliability study of the 13 identical 
items indicated a rank correlation coefficient • (Spearman) significantly different 
from zero at the 0.01 level. The items v/ere very stable in this test-retest 
situation. The per cent correct deviations ranged from 10.6 to Ten of 

13 scores deviated no more than 5.1 per cent. These statements are based on an . 
N of 6 teachers and 580 students (Development of Inquiry Skills, i971b). 

During 1971-72 the instrument was changed from a 20-item to a 33-item in- 
strument and was termed As sessment of Role Functions . The longer instrument 
was found to be less useful due to its length and an unequal distribution of 
items related to each of the four roles used in the small groups. Further, it 
was found that some of the items v/ere ambiguous and could be attributed to more 
than one rolo. In revising this instrument for the 1972-73 field test, the 
professional judgment of tiiree program development specialists, one research and 
evaluation specialist, and two experienced IRA teachers was combined to select 
the 20 items (five for each role) which v/ere most obviously characteristic and 
exclusive to a role. The revised form was designated Understanding Role Respon- 
sibilities. The IRA staff set a score of 30, or 75 per cent of tlie maximum 
possible score (twenty items, each item valued two points, maximum possible 
score of 40), as being a satisfactory criterion level as a class mean. The 
instrument was administered during the 1972-73 field test as part of the' end- 
of-Theme I evaluation. Results per teacher are shown in Jable 3. 



TC TA (UK) PA 1. 

@ TA DR PA 2. 

TC TA m @ 3. 

TC (ta) DR PA 4. 
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TAljLE 3: Unclerstandi nc] Role Responsibilities Data From 
End of Til erne I 









' ( U|.'u i ciT^ 1 Ufl 








TrOiTi V;!i 1 cn 






otuuent 


Sample v/as 


1 cuLllt: 1 hU w 


• A 


ii 


tfikon 










01 


20.9 


24' 


150 


02 


20.0 


24 


140 


03 


18.9 


21 


80 


04 . 


30.0 


25 


30 


10-14 


20.0 


85 


500 


20 


20.2 


20 


35 


21 


29.8 ; 


20 


70 


22 


26.7 


26 


70 


30 


29.3 


28 


. 105 


31 


22.4 


25 


105 


40 


28.0 


103 


103 



Table 3 shov/s that the students of only one teacher reached the criterion 
level. The criterion level v;as not emperically based, and these data indicate 
that it may have been set unrealistically high. Note tliat students in most 
cases had only experienced the performance of one role by the end of Theme I. 
It may be that they had adequate i;nov/ledge of their ov/n role," but inadequate 
knowledge of tiic other three. It v/as also found that four items on the instru- 
ment v/ere not clearly stated (in terms of role specific task descriptions); 
these have been modified in. the revised materials. Note that even though stu- 
dent means did not reach the criterion level except in one case, all mean scores 
reported v/ere well above the chance level of the instrument (chance score = 
lOoO). Further study of the instrument, particularly v/ith a viev/ toward 
establishing an emperically based criterion level, is v/arranted. 

Attitude Development Goals : 

Chapter 5 of Inquiry Objectives in the Teaching of Diology (Binnman, et al >, 
1969) identifies 12 attitudinal qualities important to success at inquiry: 
curiosity, openness, reality orientation, risk-taking, objectivity, precision, 
confidence, perseverance, satisfaction, respect for theoretical structures, 
responsibility, and consensus and collaboration. In addition, 48 related ob- 
servable behaviors are identified. This set of attitudes and related behaviors 
provided the base for delineating the attitudinal development goals of the IRA 
program. While this had been done to "some degree previously (DIS Program, 1970), 
attitudinal goals for each of the three IRA themes were identified as part of 
the revision for the 1972-73 field test. These goals follow: 

THEME I ATTlTUDIflAL QUALITIES : 

The attitudinal qualities to be developed are those necessary for an inquiry 
orientation. 
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!• A willinciness to participate in inquiry activities.. 

2. A willingness to assume responsibility in inquiry activities. 

3. A wil 1 inpness to cooperate with other students to complete an inquiry 
activity. 

4. A willingness to change ideas and evidence vmen necessary. 

5. A willingness to admit your mistakes. 

6. A willingness to look for additional data and evidence. 
7o A concern for issues in the public domain. 

8. A willingness to consider knowledge as tentative. 

9o A willingness to record and report data as it was actually observed. 

THEME II ATTITUDIIIAL QUALITIES : 

Attitudinal qualities to be developed are those necessary for development 
of inqii^Jry skills. 

1. A coHTiiitment to examine your role and then make changes in your role 
or try new ideas in your inquiry activities. 

2o Satisfaction or confidence that inquiry activities are helping you. 

3. An understandinc) and preference for certain scientific values that 
underlie science. 

4. Perseverance to stay with the inquiry task. . 
THEME Iir ATTITUDINAL QUALITIES : 

1. A belief or value that the inquiry process can affect his daily life 
. positively both in and outside the classroom. 

2. A desire to engage in a variety of divergent problem situations in 
the classroom and community. 

3. A desire to move towards self-direction and control of his own learn- 
ing activities. 

4o A commitment to identifying and prioritizing factors affecting a 
decision in order to make a more responsible decision. 

5. A belief or value that he can carry out the team decision-making process 
with persons having different ideas, viev;s, and interests. 

6. A belief that different habits of thought, creative abilities, and 
talents are important to conducting effective inquiry. 
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Measuring Attitudinal DevGlopment : 

A notable exception to the lack of instrumentation for measuring social 
skills and attitudes discussed earlier is the Diology Student Dehavjor I nventory 
developed by Steiner (1970). This instrument nieasures four of tlie 12 atti tuciilTal 
qualities identified in Inquiry Objectives in the Teaching of Biology : respon- 
sibility, curiosity, openness, and satisfaction. Tiie iiSbl has been Hescribed 
in paper one of this paper set. 

A more comprehensive instrument or set of instruments was required for 
measuring attitudinal qualities. Checklists, following the pattern for the 
social skills checklist, v^ere designed for each of the three IRA themes. Validity 
was established by judgment of staff and consultants, as done with the social, 
skills checklists. 

The attitude checklist for Theme I follows. 

Theme I A ttitude Checklist (IRA student form 121-5, Bingman, et al^. , 1972) 
"TCopy righted by ilid-continent ilegional Educational Laboratory; do not 
reproduce without permission.) 



NAME: 



TEAM MEI1BERS: 



Summary: To help you determine your attitude development, you and your 
teaiiunates will fill out this checklist. Tlie rating is given in terms of 
how often a behavior occurs. For some items it is not necessary to indicate 
the frequency and may be more appropriate to indicate how v/ell a behavior 
is performed. A rating of *'5*' is always the best a student can receive. 

1-rarely or never 2-seldom 3-sometimes 4-frequently 5-very frequently 

In Thenie I a student should have developed these attitudes: 

1. A willingness to participate jn inquiry activities. 

2. A willingness to assume responsibi Vi ty in inquiry activities. 

3. A willingness to cooperate with other students to complete an inquiry 
activity. 

4. A willingness to change ideas and evidence when it is necessary. 

5. A willingness to admit his mistakes. 

6. A willingness to look for additional data and evidence. 

7. A concern for issues in the public domaino 

These attitudes are often demonstrated by the follov/ing behaviors. Rate 
the student on how often or how v/ell he has performed these behaviors. 

YOUR TEAH 

RATING RATING 

K Reports his data, ideas, and evidence even 

when they do not agree with those of others. 
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YOUR TEAI! 
RATIIJG RATII;G 



2. Volunteers his opinions and ideas freely 
during inquiry activities. 

3. Suggests changes to improve discussion 
procedures or v/orking in the laboratory. 

4. Shows respect for the ideas of other 
students. 

5. Admits his mistakes. 

6. Carries out his assigned responsibilities. 

7. Responds to the ideas expressed by other 
students. 

8. Tells others v/lien they do not carry out 
their role functions or other assigned 
responsibil i ties. 

9. Challenges the ideas, evidence and assump- 
tions of other students. 

10. Asks other students to help him carry out 
an assigned responsibil ity when it is 
necessary to help the team. 

11. Expresses a desire for more data, ideas, 
and evidence. 

12. Volunteers to help others carry out their 
assigned responsibility when it is nec- 
essary to help the team. 

13. Suggests v/ays in v;hich scientific findings 
can be related to world problems or public 
issues. 

TOTAL 



Your rating + team rating divided by 2 = Theme I attitude rating: 



ERLC 



In vievi of the 1-5 rating system, ratings can be interpreted according to the 
following scale: 

Very frequently 59-65 

Frequently 46-58 

Sometimes 33-45 

Seldom 20-32 

Rarely or never 13-19 

A rating of 33 was set as the criterion level. 
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This checklist v/as administered to students at the end of Theme I. The 
results per teaclier are shov/n in Table 4. 

TABLE 4: Attitude Checklist Data From End of Theme I 









Population 
from which 












Student 


sample was 


'Teacher flo. 


I 


M- 


taken 










01 


43.7 


24 


150 


02 • 


48.4 


23 


140 


03 


46.6 


22 


80 


10-14 


41.7 


02 


500 


20 


44.4 


20 


35 


21 


45.6 


20 


70 


22 


49.4 


26 


70 


30 


43.0 


27 


105 


31 


51.1 


25 


105 


40 


47.0 


103 


103 



The table shov;s that all student groups reached criterion on the attitude 
checklist. The raean scores ranged from 4K7 to 51.1. Four teachers reported 
student raean scores classified as "sometiir.es" and six reported mean scores in 
the "frequently" category. 

The criterion referenced reliability for this instrument v/as found to be 
0,81 (N=20). The rank correlation between the individual's rating and the 
group's rating was 0.88 (ti=20). 

IhQ Theme II and Theme III attitude checklists follow the pattern of the 
Theme I checklist. (Note, however, that the Theme II and III attitude check- 
lists include only items related to the attitudinal goals of their own theme; 
they do not repeat items related to goals from the previous theme, as do the 
social skill checklists.) Eight teachers submitted data from administration 
of the Thema II checklist (teachers 02, 03, 10, 11, 12, 13, 14, and 21). One 
teacher (teacher 03) submitted ^Jata from administration of the Theme III check- 

Ratings for the Theme II and III checklists can be Interpreted according 
to the following scales: 



Theme II Checklist 



Theme III Checklist 



Very frequently 
Frequently 
Sometimes 
Seldom 

Rarely or never 



77-85 
60-76 
43-59 
26-42 
17-25 



59-65 
46-58 
33-45 
20-32 
•13-19 



Criterion level for Theme II checklist is 43; for Theme III checklist, 33. 
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Data from these instruiiionts is shown in Table 5. 
TABLE !)-. Attitude Checklist Data, Themes II and III 





J 


S.D. 


N 


Population 
from which 
sample was 
taken 


Theme II 




11.4 






Attitude Checklist 


58.3 


50 


790 


Theme III 










Attitude Checkl ist 


43.4 


8.37 


20 


80 



The criterion referenced reliability for the Theme 11 checklist v/as found 
to be 0.62 (11=50); for the Theme III checklist, 0.62 (N=20). Rank correlation 
betv/een individual ratings and group ratinqs v/ere 0.86 (Theme II checklist, 
N=20) and 0.134 (Theme III checklist, N=20). 



The data resulting from the use of these three attitude checklists indi- 
cates that the attitudes measured are developed and that criterion levels are 
not too high. Further studies of the validity, reliability, and setting of 
the criterion levels are suggested and will be discussed in the follov/ing 
section of this paper. 

F urther Study of the Instruments 

The data on the Social Skill Checklists and Attitude Checklists are 
summarized in Tables 6 and 7, respectively. 

TABLE 6: Summary of Data for the Social Skills Checklists 





Criterioii 


X 


S.D. 


N 


Correlation 
Ind. vs Group 


N 


Cri terion 

Referenced 

Reliability 


U 


IIo. of 

Teachers 

Represented 


Theme I 
Theme II 
Theme III 


28 
53 
53 


39.3 
71.8 
74.3 


13.3 
18.40 


393 
50 
20 


0.92 
0.86 
0.85 


20 
20 
20 


0.84 
0.60 
0.64 


20 
50 
20 


15 
8 
1 


TABLE 7: Summary of Data for the Attitude Checklists 




Criterion 


J 


S.D. 


fl 


Correlation 
Ind. vs Group 


N 


Criterion 
Referenced 
Rel iabil ity 


n 


No. of 

Teachers 
Represented 


Theme I 
Theme II 
Thome III 


33 
43 
33 


45.6 
58.3 
43.4 


11.4 
8.4 


372 
50 
20 


0.88 
0.86 
0.54 


20 . 
20. 
20 


0.81 
0.62 
0.62 • 


20 
50 
20 


14 
8 
1 
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Validity Studies ; 

Validity of these instruments has been judged primarily by IRA development 
staff mciiiberSo Further evaluation of instrument validity should be carried out by 
a panel of judges other than 1\V\ staff including experienced IRA teachers, science 
educators, and otiier educators with background experience related to social skill 
and attitude devolopnent in secondary studentSo Concurrent validity, assuming that 
instruments can be identified which share validity with the social skill and atti- 
tude checklists, should also be studied, 

A technique has been used by Moore and Sutinan (1970) for studying validity 
by providing relevant and irrelevant instruction over a brief period to two com- 
parable groups with pre and post administration of an instrument. Sensitivity 
of the instrument to the positive and negative instruction is (or is not) derjion- 
strated^ Investigation of this procedure for application to the Social Skill 
and Attitude Checklists should be considered* 

Confidence in the criterion levels established for these instruments should 
be reviewed as a result of the further validation studieSo 

Reliabi n ty : . 

While the individual score vs. group score correlations and criterion-- 
referenced reliability studies have generated confidence in the reliability of 
these instruments, further studies could include a test-retest reliability. 
(Since the i!)dividual rating \/as followed by the group rating, and the individual 
participated in the group to decide the group rating, it was decided that the 
individual vs. group correlation provided data somewhat analogous to a test- 
retest study. Obviously, the test-retest data is more desireable.) 

Summary 

The specification of social skill and attitude development goals in the 
Inquiry Role Approach program, and the development of instruments used to assess 
social skills and attitudes are reviewed. Data from the use of these instruments 
during the 1972-73 IRA field test are presented. The data show good criterion 
referenced reliability (0.84, 0.81) for two of the six instruments, and acceptable 
criterion referenced reliability (0.64, 0.62, 0.62, 0.60) for the remaining four. 
Suggested further studies of these instruments are discussed. 
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